Each score pertains to the combined test set of the language, without distinguishing individual treebanks and the enhancement types they annotate. The last line shows the macro-average over languages.
Language | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS |
Arabic | |||||||||||||||
Bulgarian | |||||||||||||||
Czech | |||||||||||||||
Dutch | |||||||||||||||
English | 99.48 | 99.48 | 86.22 | 95.75 | 0.00 | 94.71 | 0.00 | 95.62 | 89.43 | 86.87 | 84.98 | 76.60 | 80.48 | 89.35 | 88.94 |
Estonian | |||||||||||||||
Finnish | |||||||||||||||
French | |||||||||||||||
Italian | |||||||||||||||
Latvian | |||||||||||||||
Lithuanian | |||||||||||||||
Polish | |||||||||||||||
Russian | |||||||||||||||
Slovak | |||||||||||||||
Swedish | |||||||||||||||
Tamil | |||||||||||||||
Ukrainian | |||||||||||||||
Average | 5.85 | 5.85 | 5.07 | 5.63 | 0.00 | 5.57 | 0.00 | 5.62 | 5.26 | 5.11 | 5.00 | 4.51 | 4.73 | 5.26 | 5.23 |
The system output for each language was split into parts corresponding to individual source treebanks. The scores then ignore errors in enhancement types for which the treebank lacks gold-standard annotation. The column LAvgELAS shows the qualitative ELAS averaged over treebanks of the same language; the final average in bold is averaged over languages rather than treebanks. For comparison, the last column then shows the coarse ELAS F1 for the given language.
Treebank | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS | Enhancements | LAvgELAS | cf. |
Arabic-PADT | (no xsubj) | 0 | ||||||||||||||||
Bulgarian-BTB | 0 | |||||||||||||||||
Czech-FicTree | 0 | |||||||||||||||||
Czech-CAC | 0.00 | |||||||||||||||||
Czech-PDT | 0.00 | |||||||||||||||||
Czech-PUD | (no codepend) | 0.00 | ||||||||||||||||
Dutch-Alpino | 0 | |||||||||||||||||
Dutch-LassySmall | 0.00 | |||||||||||||||||
English-EWT | 99.15 | 99.15 | 81.18 | 95.45 | 0.00 | 95.59 | 0.00 | 96.70 | 88.06 | 85.64 | 82.99 | 77.30 | 80.55 | 88.41 | 88.06 | 89.02 | 88.94 | |
English-PUD | 99.86 | 99.86 | 96.25 | 96.10 | 0.00 | 93.66 | 0.00 | 94.34 | 91.06 | 88.33 | 87.48 | 75.72 | 80.40 | 90.44 | 89.97 | 89.02 | 88.94 | |
Estonian-EDT | (no xsubj) | 0 | ||||||||||||||||
Estonian-EWT | (no codepend, no xsubj) | 0.00 | ||||||||||||||||
Finnish-TDT | 0 | |||||||||||||||||
Finnish-PUD | (no codepend, no xsubj) | 0.00 | ||||||||||||||||
French-Sequoia | (no gapping, relcl, case) | 0 | ||||||||||||||||
French-FQB | (no gapping, relcl, case) | 0.00 | ||||||||||||||||
Italian-ISDT | 0 | |||||||||||||||||
Latvian-LVTB | 0 | |||||||||||||||||
Lithuanian-ALKSNIS | 0 | |||||||||||||||||
Polish-LFG | (no gapping) | 0 | ||||||||||||||||
Polish-PDB | 0.00 | |||||||||||||||||
Polish-PUD | 0.00 | |||||||||||||||||
Russian-SynTagRus | 0 | |||||||||||||||||
Slovak-SNK | 0 | |||||||||||||||||
Swedish-Talbanken | 0 | |||||||||||||||||
Swedish-PUD | 0.00 | |||||||||||||||||
Tamil-TTB | (no gapping, xsubj, relcl) | 0 | ||||||||||||||||
Ukrainian-IU | 0 | |||||||||||||||||
Average | 7.11 | 7.11 | 6.34 | 6.84 | 0.00 | 6.76 | 0.00 | 6.82 | 6.40 | 6.21 | 6.09 | 5.46 | 5.75 | 6.39 | 6.36 | 5.24 |